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Abstract 

We describe a class of parameterized reversible *a»> 
able lejiaih codes that have length distributions identi- 
cal to Uohmb-Rice codes and *xp-Golomb codea. The 
pdfs io -which these codes correspond are well matched 
to statistics of image and video data, thus enabling 
an increase in robustness to channel errors with no 
penalty in coding efficiency. These cedes art applica- 
ble to MPEG-4 and other algorithms that aim to use 
variable length codes in error-prone environments. 



1 Introduction 

The overwhelming majority of current image and 
video coding standards and systems use some form of 
run length and entropy coding to obtain efficient com- 
pression. This results in variable length codes that 
art very vulnerable to transmission over a noisy chan- 
nel because of the synchronization losses that can ac- 
company bit errors. Although in principal one could 
increase robustness by replacing variable length codes 
with fixed length codewords such as those used in some 
types of vector quantisation, toed length codes are not 
typically as efficient as traditional entropy codes in 
complexity- and m em ory ~constr ained environments. 
In addition} in developing next-generation solutions 
for robust image and video communications there is 
strong incentive in some of the image and video cod- 
ing standards organizations to preserve the bask run* 
length/Huffman coding framework used in algorithms 
such as MPEG-1. MPEG-2, H.263> and MPEG-4. 

The above considerations have kd to a crowing 
level of interest in reversible variable length codes 
(RVLCs). The idea behind RVLCs is that decod- 
ing can be performed by processing the received bit- 
stream cither for war dB or backwards. For example, 
a decoder can begin by processing the received bit- 
& bream in the forward direction , and Upon detecting 
an error, proceed immediately to the end of the bit- 
stream and decode in the reverse direction. This, and 
similar strategies can be used to significantly reduce 
the effects of bit errors on the fidelity of the decoded 
video. Although entropy coding has received exten- 
sive attention for many decades, RVLCs have received 



significant attention only recently, particularly in- as- 
sociation with work in the community. 

One of the first publications describing RVLCs in 
detail was by Takishima, Wada and Murakami in [1], 
Takishi ex al. studied the conditions for the existence 
of KVLCs and proposed algorithms for their construc- 
tion. Most recently, Toshiba and Ericsson J6J proposed 
two different schemes for constructing RVLCs with 
systematic structures that enable easy coding and de- 
coding. The principal contribution of the present pa- 
per is the introduction of RVLCs that have Identical 
code length distributions to previously known, non- 
reversible VLCe that are known to ba near-optimal for 
pdfe that occur in coding of image data. The KVLCs 
presented here axe parameterized to allow them to be 
adapted to match a wide range of pdfe, and enable the 
advantages of two-way decoding while retaining the ef- 
ficiency of traditional (non- reversible) variable length 
codes. 

2 Code Description 

We begin by presenting a reversible code with the 
same length distribution as Golomb-Rice codes. The 
ideas behind Golomb-Rice codes were originally pro- 
posed in [2] and (3), and have recently, been applied for 
coding of prediction errors in lossless image coding ap- 
plications [4]. Golomb-Rice codes are nearly optimal 
for coding of exponentially distributed non-negative 
integers, and describe an integer n in terms of a quo- 
tient and a remainder. For simplicity, the divisor is 
often chosen to be a power of 2, 2*, and is parameter- 
ized by k. The quotient can be arbitrarily large and is 
expressed using a unary representation; the remainder 
is bounded by the range [0, 2* - 1] and is expressed in 
binary form using k bits. lor example, for a Golomb- 
Rice code with k = 2 the number 9 could bo repre- 
sented as 110 01. The "prefix* of the codeword, 110, 
identifies the quotient of 9/2 2 as having value 2. The 
"suffix*, OX is a 2-bit binary expression of the remain- 
der. Table la gives Golomb-Rice codes for the first 
ocveral integers lor two choices of the parameter k. 

lb obtain an equivalent length reversible code, one 
can simply replace the prefix of each Golomb-Rice 
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codeword with a prefix that begins and end* with a 
with ail other bits equal to "0*. The exception 
to this is the prefix of length one, which is set to "0\ 
Tike suffix in the RVLC remains the same as the suffix 
in the corresponding GolombrRice code.* RVLCs con- 
structed according to these rules are shown in Table la 
tor Jfc = 1 and k = 2, and it is clear from the table that 
the length distributions of the RVXCs and the corre- 
sponding Golomb-Rice codes ate identical. Although 
it is only the prefix, as opposed to the entire codeword, 
that is symmetric, these codes can easily be decoded 
Mdirectionally because the non-symmetric portions of 
the codewords have fixed length. Figures la and lb 
provide a comparison of the code trees corresponding 
to the k =s 1 Golomb-Hice code and the corresponding 
RVLC from Table la. 

In contrast with the Golomb-Rice cods in which the 
number of codewords at each length is constant, it is 
also possible to construct codes in which the number of 
codewords of a given length grows exponentially with 
length. Compression of run lengths using such codes 
was described in a paper by Teunola [5] using the term 
"exponential- Golomb" coding. Exp-Golomb codes are 
matched to pdfe having a higher peak and wider tails 
than typical exponential pdfe. Such a pdf is very well 
matched to the run-length coded data that occur in 
quantized image transforms. Exp-Golomb codes can 
oe parameterized according to t, the number of bite 
in the suffix of the codeword. Table lb illustrates the 
exp-Golornb code for 1. It is-possible, though less 
straightforward, to construct a reversible code that 
has the same length distribution as an exp-Golomb 
code. To do this we again impose the constraint that 
the first ana last bits of the prefix be T. As before, 
the prefix of length one is set to a 0» , We require that 
all odd-indexed bits in the prefix, with the exception 
of the first and last hit, be a 0" . For example, in all pre- 
fixes of length 5> the third bit is "0" and the first and 
fifth bits are a l n . The even-mdexed bits are allowed 
to vary arbitrarily, allowing 2< t_l)/2 possible prefixes 
of length l 9 where I is odd. In constructing the code, 
each prefix is concatenated with the 2* distinct suf- 
fixes of length k. Table lb rives an RVLC constructed 
according to these rules. Again, it is clear that the 
length distribution of the RVLC is identical to that of 
the comeponding reversible code. Code trees for the 
Jfc = 0 exp-Golomb code and corresponding reversible 
code are shown in figures 1c and Id. 

3 Error Handling 

Since codewords in both the reversible exp-Golomb 
and reversible Golomb-Rice codes have fixed length 
suffixes of size k, any bit errors occuring in these suf- 
fixes will not result in error propagation. Errors in 
the prefixes, however, can result in error propagation 
or equivalently, loss of synchronization. For the re- 
versible Golomb-Rice codes, any error at any position 
within the prefix will cause loss of synchronization, 
while for the reversible exp-Golomb codes, error prop- 
agation will occur if and only if bit errors occur m 
odd-indexed positions of the prefix. Any single bit er- 



ror can be classified as either a "propagating bit error* 
or a ''non-propagating bit error depending on where 
it occurs. 

As an example of how these, issues effect the exp- 
Golomb codes, consider a source of non-negative in- 
teger symbols i, • > 0, each with probability pfi). 
The average length (in bits/symbol) after coding this 
source using the reversible exp-Golomb code will be 
I = E£o J>(0'(>% where = k+W[U>* 2 (l+i/&)\ 
is thelength of the reversible exp-Golomb code with 
parameter k for integer t . If a single bit error b ap- 
plied to the bitatream produced at the coder outr 
pufc, the probability that this error will occur in a 
codeword representing integer i is p{%)l(%)fL. Sim- 
ilarly, the probabilities of the error occuring in ci- 
ther the odd or even positions in the prefix of code- 
word i are bUyjM/L and Mt)U(WL respectively, 
where / 0 (0 mi w) the number of even and 
odd positioned bits in the prefix of codeword i, so 

1.(3 + + 

In the case where the source pdf satisfies p(i) e 
2" r W and is therefore matched to the reversible exp- 
Golomb code, the probability that a single bit er- 
ror will be non-propagating is ££o + *) 2 ~ ,w1 /^ = 
(h + l)/(* + 3). It can be shown that this is identical 
to the probability that a randomly applied single bit 
error will be non-propagating for a nonreversible exp- 
Golomb code. Similarly, the probability that an app- 
plied bit error will be non-propagating is k/(k +2) tor . 
both reversible and non-reversible Gblomb-Rice codes. 
When a propagating error occurs in a nonreversible 
code, it is well known that the decoder can usually 
re-establish synchronisation, though perhaps with the 
insertion or deletion of symbols. rW reversible codes, 
however, the decoder can not generally resynehronize 
when there is only one propagating bit error; a second 
propagating error is needed to enable ^synchroniza- 
tion. Therefore, in general error propagation will be 
more severe for reversible code* than non-reversible 
codes with the same code length distribtnion. This is 
balanced by the fact that when, due to multiple er- 
rors, resynchronization does occur, a reversible code 
cap permit more information to be extracted at the 
decoder regarding which portions of the decoding re- 
sult are correct. 

There are many possible decoder strategics for ex- 
ploiting reversible codes to improve robustness, involv- 
ing the usual tradeoffs between computational com- 
plexity and performance. As an example, consider a 
system in which the number of bits to be decoded is 
known a priori, and in which some of the nodes of the 
code tree are invalid and can serve as "traps* to detect 
errors. This occurs in some video coding algorithms 
that involve transmission of entropy coded motion vec- 
tors in a packet of information whose length is given 
in a header. Out-of-ranze motion vectors serve as the 
traps for invalid data. One simple decoding strategy 
m this case involves having both the forward and back- 
ward decoders keep track of a bitstrcam pointer to de- 
termine where to stop decoding. The forward decoder 
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will atop when the pointer reaches (or, m the case there 
are errors, proceeds past) the last bit before the end 
of the packet; the backward decoder will stop when 
the pointer reaches (or, if errors have occured, points 
to a location proceeding) the first bit of the packet. 
The decodes* will also save information regarding the 
location of any invalid data found, and perform oper- 
ations necessary for successful subsequent error check- 
ing when receiving "traps". After forward and back- 
ward decoding id complete, if both decoders stop at the 
correct positions, the two decoded symbol aeouences 
axe compared and those portions which are identical 
are used for subsequent decoding. If only one of the 
two decoder* (decoder A) Stops at the correct position, 
the initial portion (before the first detected error) of 
the symbol stream it produces will be considered cor- 
rect. The final portion of the symbol stream can also 
be compared with the initial output from decoder B» 
and the consistent symbols can be considered correct. 
If neither decoder stops at the right position, then 
conventional forward only decoding can be used, with 
data after the first detected error discarded or nagged 
as potentially incorrect* 



4 Experimental Results 

To explore the error- robustness of the proposed 
codes, we used the KVXCs in Table lb far entropy 
coding of the runs and levels of the 512 by 512 Lena 
image after performing a block DCT, sigjag scanning, 
and quantization with the standard JPEG quantiza- 
tion tables. The JPEG K Q-factor" was adjusted to 
givB a bit rate after entropy coding of .5 bpp. To sim- 
plify the mapping of the codewords in Table lb, runs 
and levels were coded separately, though it is also rel- 
atively straightforward to apply the entries in Table 
lb to joint coding of (run/level) pairs. Coded images 
were subject to corruption using a binary symmetric 
channel with bit error rates (BER) of tO" 4 and 10" s . 
At each BBR, 1000 runs of the simulation were per- 
formed. Decoding was performed^ first in the forward 
direction only, and subsequently in both the forward 
and reverse directions. This allows a direct assessment 
of the benefit of applying bidirectional decoding. At a 
BER of lO -4 , the bidirectional decoding gave an image 
domain PSNR that was on average 2.2 dB superior to 
the PSNR obtained using forward decoding only. The 
average PSNR improvement at 10~* was .9 dB. 

We also carried out, in collaboration with Raj 
Talluri and Yaehoda Nag of Texas Instruments, an 
MPEG-4 core experiment to examine the performance 
of the reversible exp-Golomb codes for the coding of 
motion vectors in a video coding system. The syntax 
of the bitsfcream, as illustrated for one packet in fig- 
ure 2, is provided by the MPEG-4 verification model 
(VM 7.0) approved in April 1997 in Bristol, UK ([7]). 
The modifications made to VM 7.0 as part of the ex- 
periment are as follows: First, instead of coding COD 
and MCBPC information separately, in our experi- 
ment, they are coded jointly with a symmetrical (and 
thus reversible) VLC. These VLCs resemble, but are 



not identical to those given in Table 1 (the differences 
arise from the need to match the code length distri- 
butions in the VM as closely as possible). The second 
modification is to replace the VLC in the VM with re- 
versible exp-Golomb codes with parameter h « 1 and 
k = 2 from Table lb. For each k, the exp-Golomb 
code of parameter k — 1 is used to code the amplitude 
of the motion vector, with an additional bit added at 
the end of each codeword to convey the sign. The last 
bit of the codeword for motion vector 0 is assigned to 1 
to avoid emulation of the MPEG-4 resynchronhiation 
marker by the motion data. 

We compared the modified coder with the VM 7.0 
in terms of coding efficiency and error robustness for 
5 QCIF format video sequences, each under & differ- 
ent error conditions including several binary symmet- 
ric channels, bursty channels, and packet lossy chan- 
nels. For each error condition, 60 simulations were 
performed, each involving the decoding of 100 frames. 
No forward error correction was usecTin the simula- 
tions. More detailed description of the simulation con- 
ditions can be found in [8]. Comparison of the sises of 
compressed sequences snows that the overhead intro- 
duced by replacing the non-reversible VLC in VM 7.0 
with the HVLC is only 1.5% in average, and ranges 
from -2.2 % to 4.5 %. For sequences such as Silent 
and Foreman, the reversible exp-Golomb codes for the 
motion data are actually more efficient than the non- 
reversible motion vector VLC in VM 7.0. These se- 
quences include rapid motion, generating larger mo- 
tion vectors which require longer VLCs (which are 
more efficiently represented using exp-Golomb codes) 
to represent. The average PSNR improvement after 
using the RVLC was about 0.3 dB. The improvement 
tended to be larger for channels of lower quality. A 
more detailed description of the experimental results 
is given in M- 



5 Conclusions 

We have introduced codes in which the codeword 
prefixes are variable length and are constructed us- 
ing symmetry constraints. The codeword suffixes are 
non-symmetric but have fixed length* This approach 
enables the design of parameterized KVLCs chat have 
length distributions that are identical to Golomh-Rice 
and exp-Golomb codes, and that are therefore well 
matched to the pdfs occuring in image and video data. 
When applied to image coding in a JPEG-Uke frame- 
work and video coding as part of an MPEG-4 core 
experiment carried out in collaboration with Texas In- 
struments, these codes allow significant improvements 
in PSNR during trans mission over noisy channels. 
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the MPEG-4 core experiment on RVLCs. 
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Figure i: Companion of eodetrees. (a) Golomb- 
Rice code (k^l): (b) Reversible Golomb-Rice code 
(k=l); (c) WGolomb codc(k=0); (d) Reversible 
exp-Golomb code (k=:Q). 



Figure 2: Packet structure for MPEG-4 core experi- 
ment. COD - Coded macroblock indication. MCBPC 
- Macroblock type and coded block pattern for chromi- 
nance. MV - Motion vector, QP - Quantization pa- 
rameter. MB No.- Index number to the first macro 
block in the packet. 
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Table 1(a) 
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Table 1(b) 

Table 1: (a) Golomb-Rice and reversible Golorab-Rice 
code; (b) Exp-Golomb and reversible codes (odd posi- 
tioned prefix bits of reversible exp-Golomb codes are 
shown in bold italic fonts). 
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